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ABSTRACT 

As colleges of pharmacy prepare a new generation 
of practitioners, it is important that during practice 
experiences students learn the impact of clinical 
interventions. For over ten years, pharmacy 
students have been a vital part of the 
multidisciplinary team at the military treatment 
facility. The overall impact of the student 
interventions on patient care has not been 
evaluated. To evaluate the impact, the students 
began documenting their clinical interventions in 
Medkeeper Rxinterventions™, an online database. 
The program is used to document faculty and fourth 
year pharmacy students' pharmaceutical 
interventions. 

Objective: The objective of this study was to 
analyze the interventions completed by fourth year 
pharmacy students during a general medicine 
advanced pharmacy practice experience at a 
military treatment facility. 
Methods: The students completing their general 
medicine advanced pharmacy practice experience 
at the military treatment facility are responsible for 
self reporting all interventions made during clinical 
rounds into the Medkeeper Rxintervention™ 
database. The researchers retrospectively collected 
and analyzed interventions made from June 2008 to 
June 2009. 

Results: The total number of Interventions recorded 
by 8 fourth year pharmacy students was 1 14. 
Students averaged a number of 14.3 interventions 
during an eight week practice experience. Students 
spent an average of 5 minutes per intervention. 
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Ninety- five percent of the interventions were 
accepted. 

Conclusion: Fourth year pharmacy students' 
recommendations were accepted at a high rate by 
resident physicians. The high acceptance rate may 
have the ability to positively impact patient care. 

Keywords: Students, Pharmacy. Education, 
Pharmacy, Graduate. United States. 

EVALUACION DE LAS INTERVENCIONES 
CLINICAS DE LOS ESTUDL4NTES DE 
FARMACIA EN UNAS PRACTICAS DE 
MEDICINA GENERAL 

RESUMEN 

Mientras las facultades de farmacia preparan una 
nueva generacion de facultativos, es importante que 
durante las practicas tuteladas los alumnos 
aprendan el impacto de las intervenciones clinicas. 
Durante mas de 10 anos, los estudiantes de 
farmacia han side un elemento vital del equipo 
multidisciplinario de la clinica militar. No se ha 
evaluado el impacto general de las intervenciones 
de los estudiantes en la atencion a los pacientes. 
Para evaluar el impacto, los estudiantes comienzan 
a registrar sus intervenciones clinicas en 
Medkeeper Rxinterventions™, una base de datos 
online. El programa se usa para documentar las 
intervenciones farmaceuticas de los profesores y los 
estudiantes de cuarto aiio. 

Objetivo: El objetivo de este estudio fiie evaluar las 
intervenciones completadas pro estudiantes de 
farmacia de cuarto ano durante las practicas 
tuteladas avanzadas en una clinica de medicina 
general de un establecimiento militar de 
tratamiento. 

Metodos: Los estudiantes que realizan sus practicas 
tuteladas avanzadas en el establecimiento militar de 
tratamiento son responsables de auto-comunicar 
todas las intervenciones realizadas durante las 
rondas clinicas en la base de datos Medkeeper 
Rxintervention™. Los investigadores recogieron y 
analizaron retrospectivamente las intervenciones 
realizadas entre junio 2008 yjunio 2009. 
Resultados: El niimero total de intervenciones 
registradas por los alumnos de farmacia de cuarto 
ano fue de 114. Los estudiantes realizaron un 
promedio de 14,3 intervenciones durante sus ocho 
semanas de practicas. Los estudiantes pasaron una 
media de 5 minutos por intervencion. El 95% de las 
intervenciones fueron aceptadas. 
Conclusion: Las recomendaciones de los 
estudiantes de farmacia de cuarto ano fueron 
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altamente aceptadas por los medicos residentes. La 
alta tasa de aceptacion puede tener la capacidad de 
impactar positivamente en los cuidados de los 
pacientes. 

Palabras clave: Farmacia, Estudiantes. Educacion, 
Famiacia, Graduada. Estados Unidos. 



INTRODUCTION 

Advanced pharmacy practice experience 
curriculums have expanded over the last decade to 
include enhanced training in developing 
individualized pharmaceutical care plans. The 
Accreditation Council for Pharmacy Education 
(ACRE) mandate that such experiences include 
direct interaction with diverse patient populations in 
various practice settings and involve collaboration 
with other healthcare professionals.^ Advanced 
pharmacy practice experiences provide fourth year 
pharmacy students with invaluable on-site 
experiences that prepare them for a more 
demanding and clinically involved role on the 
patient-oriented health care team. During clinical 
experiences, it has been proven that pharmacy 
students have an immense impact on medical 
interventions directly affecting patient care. 
Pharmacists and pharmacy students have 
demonstrated positive effects on patient care 
outcomes, including the prevention of adverse drug 
reactions and medication errors, improvement of 
patient satisfaction and quality of life, and 
improvement of economic outcomes.^"^° 

The opportunity to document interventions in an 
online database allows the interventions, 
recommendations, and actions to be recorded and 
reviewed to help evaluate its importance. In a study 
conducted by King et al, the significant impact 
pharmacy students have in identifying, 
recommending, and documenting clinical 
pharmacotherapeutic interventions was evaluated.^" 
The use of personal digital assistants (PDA) allowed 
students to document interventions while on 
medical rounds through the MedKeeper's 
intervention tracking program called RxRounds™. 
The interventions were divided into two categories: 
drug modification (prevention of adverse effects, 
drug substitutions, formulation/route changes, and 
interval modifications) and drug information (general 
consults, including pharmacokinetic consults, 
patient counseling, or any general information). ^° 

At the end of the 12 week study, 50 interventions 
involved drug modifications and 54 interventions 
involved drug information.^" The majority of the 
interventions involved drug initiation and drug 
substitution. ^° Only 2.2% of the interventions were 
rejected by the preceptors.^" 

As the practice of pharmacy evolves, doctor of 
pharmacy programs continue to expand their 
training to more hospital sites to expose pharmacy 
students to the management of various disease 
states." For over 10 years, pharmacy students 
have been an essential part of the medical team at 
the military treatment facility. The students attended 



medical rounds with family practice and internal 
medicine physicians, residents, and interns. The 
students had the opportunity to make significant 
interventions by reviewing the patient's medical 
chart, being a part of the patient discussion, and 
serving as a resource to the medical team. Over the 
years, various preceptors required pharmacy 
students to document their interventions using a 
paper system. These interventions are no longer 
available and were not evaluated. 

In 2008, the preceptor implemented the 
documentation of clinical interventions as one of the 
fourth year pharmacy students' daily activities. The 
students documented the interventions using the 
Medkeeper Rxinterventions™ program. This system 
helps to document cost savings, report the value of 
pharmacy activities, and justify staffing. Moreover, 
it allows organizations that subscribe to the program 
an opportunity to quickly and efficiently track clinical 
interventions, activities, adverse drug events, and 
medication errors.^^ The purpose of this study was 
to analyze the interventions completed by fourth 
year pharmacy students during a general medicine 
advanced pharmacy practice experience at a 
military treatment facility. 

METHODS 

The university's College of Pharmacy and 
Pharmaceutical Sciences (COPPS) subscribes to 
the Medkeeper Rxintervention™ program. This 
application was developed to document clinical 
pharmacists' interventions. The COPPS utilizes the 
program to document faculty and fourth year 
pharmacy students' pharmaceutical interventions. 

The researchers received approval from the 
institution's investigational review board to conduct 
the research. The participants were fourth year 
pharmacy students completing their General 
Medicine I and II advanced pharmacy practice 
experience at a 60 bed military treatment facility. 
The preceptor for the experience was a pharmacy 
practice faculty. During the 8 week experience, the 
participants were responsible for documenting all 
interventions. The completion of the interventions 
was not part of their final grade but it was a part of 
their daily activities. The participants began 
documenting the interventions in June 2008. The 
preceptor trained the students on the Medkeeper 
Rxinterventions™ program. The preceptor defined 
the intervention categories, provided examples of 
interventions, and explained how to document the 
required information into the database. The 
students were responsible for voluntarily self 
reporting all interventions made during medical 
rounds. The students were encouraged to input 
interventions at least once a week. If an intervention 
was categorized as pending, the students were 
responsible for changing the status upon receiving 
the necessary information to one of the following: 
accepted or rejected. 

The researchers retrospectively collected and 
analyzed interventions from June 2008 to June 
2009. The researchers utilized the Rxintervention™ 
program to generate intervention reports based on 
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requested parameters. In order to assess the data 
collected by the documentation system, the 
information was categorized into the appropriate 
identifiable categories that range from site of 
intervention (i.e. Naval Hospital), type of 
intervention, and response to intervention (i.e. 
accepted or rejected). 



RESULTS 

The total number of interventions recorded from 
June 2008 to June 2009 by 8 fourth year pharmacy 
students was 114. Each student averaged 14.3 
interventions during an 8 week rotation period. This 
equates to 1.8 interventions per student per week. 
This number reflects interventions with the status of 
accepted, rejected and unknown. Students spent an 
average of 5 minutes per intervention. The average 
cost savings was USD563.00 per student. This 
information can be found in Table 1 . 



Table 1. Student interventions documented between June 
2008 and June 2009. 


Categorical Data 


Value 


Total Number of Interventions documented 
(n=) 


114 


Average Number of Interventions During 8 
week rotation per student (both accepted and 

rejected) 


14.3 


Percentage of Accepted Interventions 


95.6% 


Average Time Spent per Intervention 
(minutes) 


5(1-10) 


Estimated Average Cost Savings 
per student (USD) 


563.00 
(200- 
1250) 



There were 65 categories listed for students to 
select as a description of the intervention 
performed. Of these 65 categories, 20 of these 
options were used more frequently. The most 
common interventions documented were drug 
information questions, drug therapy review, dosing 
consult, and antibiotic consult at 24%, 15%, 13%, 
and 9% respectively. This information can be found 
in Table 2. 



Table 2. Percentages of the Most Frequently 
Reported Interventions 


Drug Information 


30% 


Drug Therapy Review 


18% 


Dosing Consult 


17% 


Antibiotic Consult 


11% 


Pharmacokinetic Consult 


10% 


More Appropriate Dose 


9% 


More Appropriate Drug 


5% 



Ninety five percent (109 of 1 14) of the interventions 
were accepted. There were 5 rejected interventions. 
Of the 5 rejected interventions, 3 were deemed 
unnecessary by the healthcare team due to the 
planned discharge of the patient. They were 
pharmacokinetic interventions, i.e. therapeutic drug 
levels or dosage changes for medications that the 
patients would no longer be receiving. 

A total of 651 minutes (10.5 hours) was spent 
completing interventions. The average time spent 
per intervention was 5 minutes. Drug information 
consults required the most time to complete with the 
average being 30 minutes. Patient counseling. 



antibiotic consults, and drug therapy review required 
20, 15, and 10 minutes to complete, respectively. 

DISCUSSION 

The acceptance rate in our study is consistent with 
other studies that have reported an acceptance rate 
of 64% to 97.9%.''^"''® All recommendations were 
verbally presented to the physician. In two studies 
evaluating written versus oral recommendations 
made by pharmacy students, it was found that 
verbal recommendations had a higher acceptance 
rate.^*"^® Pound and Miller reported an 82.8% 
acceptance rate of verbal recommendations 
compared to 54.2% of written recommendations 
(p<0.0001).^^ In the Lundquist et al study, the 
acceptance of verbal recommendations versus 
written recommendations was 97.9% vs. 83.6%, 
respectively.^® It was concluded that the higher rate 
of acceptance may be due to the student's face-to- 
face time with the physician and the opportunity to 
engage in discussions regarding patient-specific 
recommendations.^^ Additionally, during the 8 week 
experience the pharmacy students developed 
relationships with the resident physicians which may 
have led them to be more receptive to 
recommendations. 

The 8 fourth year pharmacy students averaged 14.3 
interventions in an 8 week period. This correlates to 
1.8 interventions per student per week. Twenty- 
seven students participated in the Dennehy et al 
study. The students were asked to document their 
interventions over a 5 day period during the first, 
third, and fifth week of a six week inpatient rotation. 
Students completed a total of 4.3 interventions per 
student per week.^'* In a similar study by Chisholm 
et al, 15 students completed 2.9 interventions per 
student per week.^° It is uncertain as to why the 
number of interventions for this study group was 
smaller than those previously reported in the 
literature. But it can be postulated that the number 
of study participants may have been a contributing 
factor. It is also unclear whether the size of the 
facility may have been a factor because the size of 
the facility was not reported in the other trials 
referenced. In addition, IDennehy et al evaluated the 
associated drug cost of the interventions. The 
annualized drug costs indicated a savings of 
USD578.75 over the 15 day study period. Our 
study reported a cost savings per student of 
USD563.00 over the 8 week study period. 

The most frequent type of intervention performed in 
our study was providing drug information (30%). 
Two other studies illustrated similar results. The 3 
year study conducted by Pham et al that included 
63 fourth year pharmacy students reported that 
46.8% of the interventions were providing drug 
information.^^ A similar study by Slaughter et al 
which evaluated 6 post B.S. second year Pharm.D. 
students over 8 months found that 40.4% of all 
interventions were drug information related.® A 3 
year study by DiVall et al which included 83 
students and 58 sites reported that the majority 
(17.8%) of the interventions in the general medicine 
setting were dose adjustment.^^ 
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After evaluating the data, there are several possible 
limitations to this study that should be addressed. 
The students were responsible for voluntarily self- 
reporting their interventions at least weekly. There is 
the potential that the students may have forgotten or 
not reported all interventions made during the study 
period. There is also the possibility that students 
may not have reported rejected interventions. This 
could have reduced the total number of 
interventions made by the students. However, the 
students were instructed to document all 
interventions: accepted and rejected. Another 
possible limitation is that the students were 
responsible for classifying the interventions. The 
students were given instructions on how to classify 
their interventions as well as examples of each type 
of intervention. However, it is possible that the 
students may have incorrectly classified various 
interventions. 

CONCLUSIONS 

Training of healthcare professionals often involves 
participation on multidisciplinary teams. For 10 



years at this military treatment facility, pharmacists 
and pharmacy students have been incorporated into 
the team. Until this study, there was no evidence to 
demonstrate the impact that pharmacy students 
have on the overall care of the general medicine 
patients in this practice setting. It is evident by the 
results of this study that the pharmacy students play 
a major role in making pharmacotherapy 
recommendations. The 95.6% acceptance rate 
reveals that the medical team was receptive of the 
pharmacotherapy recommendations. This study 
opens the door for the need of larger studies that 
evaluate the impact of pharmacy student clinical 
interventions at multiple advanced practice 
experience sites, exploration into the overall benefit 
of interventions based on the type or documentation 
method, and the potential cost-savings due to the 
avoidance of medication errors. 
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